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Preface 

The  purpose  of  this  research  was  to  investigate  the  enhancement  of  satellite 
images.  The  immediate  need  for  this  research  is  to  improve  intelligence  imagery. 
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for  showing  me  the  tricks  of  the  trade.  I’d  also  like  to  thank  the  other  members 
of  my  thesis  committee,  Dr  Byron  Welsh  and  Capt  (Dr.)  Dennis  Ruck.  Additional 
thanks  go  to  Messrs.  Dan  Zambon  and  Dave  Doak  for  guiding  me  through  the 
computer  wilderness.  My  gratitude  also  goes  to  the  AFIT  library  staff  for  their 
patient  assistance  in  helping  me  find  references. 
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Abstract 

This  research  investigated  the  enhancement  of  satellite  images.  The  goal  was 
to  develop  and  test  a  suite  of  image  enhancement  software  routines  to  improve  the 
quality  of  reconstructed  images  for  the  human  visual  system.  The  primary  focus  was 
to  enhance  satellite  features.  Enhancement  was  accomplished  in  both  the  spatial  do¬ 
main  and  the  frequency  domain.  In  the  spatial  domain,  routines  were  developed  to 
enhance  image  contrast  and  image  edges.  In  the  frequency  domain,  a  routine  was 
developed  using  research  into  the  human  visual  system.  The  transfer  function  of  the 
human  visual  system  was  used  to  develop  a  filter  for  frequency  domain  enhancement. 
A  data  set  of  images  was  developed  using  software  to  simulate  the  image  degradation 
caused  by  atmospheric  turbulence  and  the  randomness  of  the  image  measurement 
process.  The  parameters  varied  in  the  simulation  were  atmospheric  coherence  di¬ 
ameter  and  total  photon  count.  The  routines  were  applied  to  this  data  set  and  the 
results  were  evaluated  by  various  image  fidelity  criteria.  These  criteria  included  an 
observer’s  subjective  fidelity  criterion  as  well  as  objective  fidelity  criteria.  All  en¬ 
hancement  routines  provided  enhancement  dependent  upon  the  parameters  of  the 
data  set  simulation.  Contrast  enhancement  worked  well  when  photon  count  was  low. 
Edge  enhancement  worked  well  when  photon  count  was  high.  The  frequency  domain 
filter  worked  well  under  all  simulation  parameters. 
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HUMAN  VISUAL  SYSTEM  ENHANCEMENT  OF 
RECONSTRUCTED  SATELLITE  IMAGES 

I.  Introduction 

1.1  Background. 

1.1.1  The  Satellite  Imaging  Problem.  The  US  Air  Force  operates  several 
space  surveillance  sites  including  the  Air  Force  Maui  Optical  Station  (AMOS),  lo¬ 
cated  atop  Mt  Haleakala  on  the  island  of  Maui  in  the  state  of  Hawaii.  A  1.6  meter 
telescope  at  this  site  obtains  high  resolution  imagery  of  space  objects,  including 
satellites  [20].  Human  analysts  use  this  imagery  in  the  development  of  intelligence 
estimates. 

Satellite  imaging  comes  with  a  set  of  problems  which  are  different  from  those 
of  conventional  imaging  [2].  First,  due  to  the  satellite’s  relatively  great  distance 
from  the  observatory,  good  resolution  is  difficult.  If  imaging  at  a  wavelength  of  500 
nm,  ai  a  range  of  500  km,  with  a  telescope  diameter  of  1.6  m,  theoretical  resolution 
is  limited  to  19  cm.  Second,  the  rapid  motion  of  a  satellite  across  the  sky  poses 
a  difficult  tracking  problem.  This  limits  the  length  of  time  during  which  photons 
may  be  collected  for  a  single  exposure  frame.  Finally,  the  satellite  rapidly  changes 
its  orientation  and  its  apparent  size.  These  rapid  changes  limit  the  time  available 
to  collect  frames  for  a  given  image  reconstruction.  Multi-frame  exposure  time  is 
generally  on  the  order  of  3  to  10  seconds  for  satellites  within  2,000  km. 

Images  of  satellites  taken  from  the  earth  suffer  from  atmospheric  turbulence- 
induced  optical  aberrations.  Turbulence  in  the  atmosphere  causes  the  atmosphere’s 
index  of  refraction  to  vary  rapidly  in  space  and  time  [17]  [18].  This  variation  leads 
to  random  phase  aberrations  appearing  in  the  telescope’s  pupil.  Random  phase 
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aberrations  '‘..use  the  optical  transfer  function  (OTF)  to  be  a  random  process.  When 
compareu  with  the  diffraction-limited  OTF  of  a  large  telescope,  the  average  OTF 
of  an  uncompensated  telescoped  is  attenuated  and  approaches  zero  at  relatively  low 
spatial  frequencies  [18].  This  high  frequency  attenuation  means  that  the  limiting 
resolution  of  the  telescope’s  imaging  system  is  imposed  by  the  atmosphere  rather 
than  by  the  size  of  a  large  telescope.  The  end  result  is  an  image  of  low  resolution 
and  low  quality. 

1.1.2  Adaptive  Optics.  An  adaptive  optics  hardware  system  partially  cor¬ 
rects  the  random  phase  aberrations  caused  by  atmospheric  turbulence  [17]  [18].  This 
hardware  system  includes  a  wavefront  sensor  (WFS)  and  a  deformable  mirror  (DM). 
The  WFS  estimates  the  state  of  the  telescope’s  generalized  pupil  function.  A  recon¬ 
struction  law  maps  the  WFS  measurements  into  commands  for  the  actuators  of  the 
DM.  The  actuator  commands  will  change  the  surface  of  the  deformable  mirror  into 
an  estimate  of  the  conjugate  of  the  phase  of  the  generalized  pupil  function.  When 
the  propagating  wave  reflects  from  the  DM,  the  variance  of  its  random  phase  aber¬ 
ration  is  reduced.  A  reduced  phase  aberration  variance  means  an  improved  average 
OTF  which  means  an  improved  image  [18]. 

The  AMOS  Compensated  Imaging  System  (CIS)  attempts  to  compensate  for 
the  aberrations  caused  by  atmospheric  turbulence  [20].  The  CIS  consists  of  a  closed- 
loop  system  with  wavefront  sensor,  wavefront  computer,  and  wavefront  corrector  to 
remove  phase  distortions  from  the  wavefront.  The  wavefront  sensor  uses  two  shearing 
interferometers  to  measure  the  slope  of  the  wavefront  in  two  orthogonal  directions 
at  152  discrete  subaperture  positions.  The  wavefront  computer  then  uses  these  slope 
measurements  to  calculate  the  corrections  necessary  to  remove  the  phase  distortions. 
The  turbulence-induced  wavefront  phase  distortion  has  both  tilt  error  and  higher  or¬ 
der  aberrations.  These  aberrations  are  removed  by  the  wavefront  correction  system. 
The  wavefront  correction  system  consists  of  a  tilt  correction  mirror  and  a  deformable, 
monolithic,  piezoelectric  mirror  (DM)  with  168  actuators  [20].  The  tilt  correction 
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mirror  uses  commands  from  the  wavefront  computer  to  remove  wavefront  tilt  error. 
The  DM  uses  commands  from  the  wavefront  computer  to  remove  the  higher  order 
aberrations. 

A  slow-scan  charge-coupled  device  (CCD)  camera  captures  the  compensated 
image  and  records  it  on  a  hard  disk  [20].  The  images  are  then  processed  to  further 
compensate  for  turbulence  effects  and,  finally,  distributed  to  the  end  user. 

1.1.3  Software  Simulation.  Michael  Roggemann  of  the  Air  Force  Institute 
of  Technology  has  developed  a  suite  of  software  routines  written  in  the  FORTRAN 
programming  language  which  simulate  the  AMOS  image  measurement  and  process¬ 
ing  system  [19].  As  actual  satellite  imagery  from  AMOS  was  unavailable,  this  suite 
allowed  creation  of  a  data  set  which  closely  simulated  AMOS  imagery.  This  suite 
simulated  the  degradation  caused  by  atmospheric  turbulence  as  well  as  the  efforts  of 
the  adaptive  optics  to  compensate  for  them.  In  addition,  this  suite  included  a  linear 
reconstruction  algorithm  which  produced  a  reconstructed  image  by  deconvolving  the 
average  point  spread  function  from  the  raw  image  after  averaging  [18]. 

The  two  components  of  the  adaptive  optics  simulation  of  interest  to  this  re¬ 
search  are:  (1)  an  adaptive  optics  component  which  consists  of  an  atmospheric  phase 
screen  generator,  a  WFS  model,  a  DM  model,  and  a  tilt-removal  system;  and  (2)  an 
image  simulation  component  which  generates  photon-limited  images  using  a  user- 
specified  object  (satellite)  and  the  user-specified  average  rate  of  photoevents.  The 
atmospheric  phase  screen  is  modeled  as  a  single  thin  phase  screen  in  the  pupil  of  the 
telescope.  The  phase  screen  does  provide  some  image  degradation. 

Tilt-removal  was  done  with  a  least-squares  fit  of  a  plane  wave  to  the  phase 
screen.  The  plane  wave  was  then  subtracted  from  the  phase  screen.  The  phase 
screen,  now  without  tilt,  was  input  to  a  Hartmann-type  WFS  model  where  phase 
difference  measurements  were  made.  The  effects  of  measurement  noise  were  included. 
Phase  difference  measurements  were  then  mapped  to  DM  actuator  commands  which 
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compute  the  position  of  the  surface  of  the  DM.  DM  phase  was  then  subtracted  from 
the  incident  random  phase  and  tilt  was  again  removed  [19]. 

The  photon-limited  images  were  captured  on  a  256  x  256  pixel  matrix.  The  ob¬ 
ject  was  convolved  with  the  instantaeous  point-spread  function  to  obtain  the  image. 
This  image  was  normalized  and  multiplied  by  the  average  number  of  photoevents  per 
image  [19].  The  image  was  then  postprocessed  using  a  linear  image  reconstruction 
algorithm  yielding  a  reconstructed  image  [i8].  This  reconstructed  image  became 
part  of  the  data  set  for  this  research. 

A  true  image,  similar  to  the  one  in  Figure  1.1,  is  the  input  object.  The  true 
image  is  a  digital  representation  of  an  actual  satellite.  A  typical  reconstructed  image 
is  shown  in  Figure  1.2.  The  true  image  represents  the  best  possible  reconstructed  im¬ 
age;  the  reconstructed  image  is  what  the  intelligence  analyst  sees.  The  reconstructed 
mage  has  poor  contrast  and  undefined  features.  If  the  reconstructed  image  can  be 
made  more  like  the  true  image,  the  intelligence  analysts  job  will  be  easier.  Enhancing 
the  features  of  the  reconstructed  image  is  the  motivation  behind  this  research. 

1.2  Problem  Statement 

The  problem  addressed  by  this  thesis  is  the  application  of  knowledge  of  the 
human  visual  system  to  develop  image  enhancement  software  routines  to  maximize 
the  transfer  of  information  from  the  reconstructed  image  to  the  human  intelligence 
analyst.  These  routines  encode  algorithms  which  enhance  in  both  the  spatial  domain 
as  well  as  in  the  frequency  domain.  Knowledge  of  the  human  visual  system  (HVS), 
including  the  modulation  transfer  function  (MTF)  of  the  HVS,  will  be  used  to  develop 
these  algorithms. 
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Figure  1.1  0CNR5  True  Image 
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Figure  1.2  0CNR5  Reconstructed  Image 
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1.3  Research  Objectives 

In  this  reseaich,  a  suite  of  image  enhancement  software  routines  which  improve 
the  quality  of  reconstructed  satellite  images  was  developed  and  tested.  This  suite 
was  transitioned  to  AMOS,  where  it  will  be  used  to  produce  better  satellite  images. 

1.4  Research  Questions 

Here  is  a  list  of  the  key  questions  this  research  must  answer: 

(1)  Can  the  contrast  of  a  reconstructed  satellite  image  be  enhanced? 

(2)  Can  the  edges  of  a  reconstructed  satellite  image  be  enhanced? 

(3)  Can  a  useful  filter  be  developed  using  the  MTF  of  the  HVS? 

(4)  Do  quantitative  metrics  rank  the  enhanced  images  in  the  same  order 
as  the  human  observer? 

1.5  Approach 

This  project  began  by  creating  a  database  of  reconstructed  images  using  Rogge- 
mann’s  software  simulation  routines  with  true  images  as  input.  Image  enhancement 
software  routines  were  then  developed  in  the  Interactive  Data  Language  (IDL).  The 
database  was  processed  by  the  image  enhancement  routines.  The  enhanced  images 
were  judged  by  both  qualitative  and  quantitative  metrics. 

1.6  Limitations  and  Scope 

This  research  is  limited  in  scope  to  the  development  of  enhancement  techniques 
and  their  subsequent  evaluation.  The  atmospheric  phase  screen  simulation  is  limited 
in  that  it  models  all  effects  of  phase  aberration  as  a  single  phase  screen  located  in  the 
pupil  of  the  telescope.  Therefore,  reconstructed  images  created  by  this  simulation 
are  isoplanatic.  In  practice,  an  actual  image  has  been  corrupted  by  a  multitude  of 
phase  screens  at  various  altitudes  and  suffers  from  nonisoplanatic  effects. 
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1.7  Key  Results 

Software  routines  were  developed  to  enhance  image  contrast  and  image  edges 
in  the  spatial  domain.  In  addition,  a  routine  was  developed  around  the  MTF  of 
the  HVS  which  allows  enhancement  in  the  frequency  domain.  All  routines  provided 
enhancement  under  at  least  some  conditions  of  the  data  set  simulation.  HVS  filtering 
provided  enhancement  under  all  conditions.  Histogram  equalization  worked  best  on 
images  of  low  photon  count  while  the  edge  enhancement  techniques  of  Sobel  function 
and  unsharp  masking  worked  best  on  images  of  high  photon  count.  Of  the  quality 
metrics  used  to  rank  the  enhancements,  the  bandwidth  and  entropy  variance  metrics 
come  closest  to  ranking  the  enhancements  in  the  same  order  as  the  human  observer. 

1.8  Overview 

The  remainder  of  this  thesis  is  organized  in  the  following  manner.  Chapter 

II  is  a  literature  r<  ’w  of  relevant  material  on  the  human  visual  system.  Chapter 

III  details  the  prob,  m  approach  and  the  enhancement  methods  used.  Chapter  IV 
describes  results.  A  conclusion,  as  well  as  a  look  at  future  directions,  is  detailed  in 
Chapter  V. 
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II.  Literature  Review 


2.1  Human  Visual  System  Attributes 

2.1.1  Brightness  Discrimination.  An  image  is  a  two-dimensional  light 
intensity  function  f(x,y ),  where  x  and  y  are  spatial  coordinates.  The  brightness  of 
an  image  at  a  point  is  its  gray  level.  Thus,  the  value  of  /  at  a  point  (x,y)  is  its  gray 
level  [6:6].  A  digital  image  is  an  image  with  discrete  spatial  coordinates  as  well  as 
discrete  brightness  values  [6:6].  The  satellite  images  enhanced  by  this  research  are 
digital  images. 

Knowledge  of  how  the  human  visual  system  (HVS)  discriminates  between  dif¬ 
ferent  brightness  levels  is  fundamental  to  understanding  image  enhancement  tech¬ 
niques.  The  HVS  can  adapt  to  light  intensity  from  the  scotopic  threshold  (the 
minimum  stimulation  required  to  excite  a  response)  to  the  glare  limit  (the  point 
beyond  which  further  stimulation  doesn’t  excite  further  response).  This  range  can 
be  as  much  as  1010  [6:26].  The  human  visual  system  perceives  brightness  as  a  log¬ 
arithmic  function  of  the  light  intensity  incident  on  the  eye.  The  visual  system  only 
operates  over  a  small  subrange  of  its  total  adaptation  range  at  a  time.  It  cannot  op¬ 
erate  over  its  entire  range  simultaneously.  This  phenomenon  is  known  as  brightness 
adaptation,  and  the  current  sensitivity  level  is  called  the  brightness  adaptation  level. 

How  does  the  eye  discriminate  between  brightness  changes  at  a  specific  adap¬ 
tation  level?  r> he  Weber  ratio  describes  where  an  increment  of  illumination  above 
background  illumination  becomes  discriminable  50  percent  of  the  time.  A  small 
Weber  ratio  means  that  small  intensity  changes  are  discriminable.  Small  changes 
are  “good”  discrimination;  large  changes  are  “poor”  discrimination  because  only 
large  intensity  changes  are  discriminable.  A  plot  of  Weber  ratio  versus  logarithmic 
intensity  shows  that  brightness  discrimination  is  best  as  background  illumination 
increases  [6:27].  Thus,  when  enhancing  in  ages  for  a  human  viewer,  it  is  desirable  to 
make  them  bright. 
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2.1.2  Edge  Processing.  In  the  HVS,  spatial  information  is  organized  into 
two  channels:  a  lowpass  channel  and  a  bandpass  channel  [7].  The  lov  oass  channel 
contains  information  about  the  contrast  across  the  image.  The  bandpass  channel 
contains  edge  information.  Because  edge  information  allows  us  to  discriminate  ob¬ 
jects,  edges  are  the  predominant  spatial  quality  of  interest.  The  retina  extracts  edge 
information  by  subtracting  the  low  frequency  information  (contrast)  and  amplifying 
the  resulting  signal  to  fill  the  dynamic  range  of  the  optic  nerve.  This  is  very  similar 
to  the  edge  enhancement  technique  of  unsharp  masking  [7].  Thus,  when  enhancing 
images  for  a  human  viewer,  it  is  desirable  to  enhance  their  edges. 

2.2  Human  Visual  System  Model 

2.2.1  Evidence  of  Linearity.  There  has  been  much  research  in  the  past 
three  decades  into  developing  a  model  of  the  human  visual  system.  These  models  are 
the  result  of  psychophysical  experiments.  These  experiments  have  determined  that 
the  HVS  is  sensitive  to  background  illumination  level  and  to  the  spatial  frequency 
content  of  an  image  [21].  The  current  model  of  the  HVS  includes  both  a  linear  and 
a  nonlinear  portion  and  assumes  that  the  HVS  is  a  shift  invariant  system  [8]. 

The  portion  of  the  HVS  up  to  the  photoreceptors,  the  cones  and  rods,  in  the 
retina  can  be  modelled  as  a  linear  system  [8].  The  validity  of  a  linear  model  for  this 
portion  of  the  HVS  was  shown  by  the  following  experiment.  An  observer  was  shown 
two  sine  wave  grating  transparencies.  The  first,  a  reference  grating,  was  of  constant 
contrast  and  constant  spatial  frequency.  The  second,  a  test  grating,  was  of  variable 
contrast  and  constant  spatial  frequency  different  from  the  spatial  frequency  of  the 
reference  grating.  Thus,  there  was  one  reference  grating  and  as  many  test  gratings  as 
there  were  spatial  frequencies  to  test.  The  observer  was  asked  to  match  the  contrast 
of  the  test  grating  to  that  of  the  reference  grating  [14:34]  [4]  [8]. 
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The  reference  grating  had  a  luminance  function 


F°(ar,  y )  =  A°wcos{uoy)  (2. 1 ) 

where  is  a  particular  spatial  frequency  and  A w  is  the  amplitude  of  the  luminance. 
The  test  grating  had  a  luminance  function 

F(x,y)  =  Awcos(u>y).  (2.2) 

Since  a  linear  shift  invariant  system  possesses  a  transfer  function  D{ u>),  the  perceived 
brightness  of  the  reference  grating  would  be 

<t>°(x,y)  =  A°^(wo)cos(woy)  (2.3) 

and  the  perceived  brightness  of  the  test  grating  would  be 

<}>{x,y)  =  AjD{u>)cos(uty).  (2.4) 

Since  the  observer  is  equating  the  apparent  brightness  of  the  test  grating  with  that 
of  the  reference  grating,  we  have 

I  4>°{x,y)  \=\4{x,y)  |  ■  (2.5) 


Thus, 


A°WD(  u>0)  =  u). 


Finally,  the  MTF  is  expressed  by 


-PH  _  AZ 

D(u o)  -4a. 


(2.6) 


(2.7) 
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There  axe  nonlinear  characteristics  of  the  HVS  due  to  a  logarithmic  transforma¬ 
tion  at  the  photoreceptors.  In  order  to  keep  the  model  linear,  the  actual  luminance 
functions  used  were  of  the  form  [4] 

F(x,  y)  =  exp  (A^  cos(wy)).  (2.8) 

If  the  photoreceptors  do  a  logarithmic  transformation  on  this  luminance  function 
[14:36],  the  photoreceptor  output  would  be 

G(x ,  y)  =  ln(exp(>l(1,  cos(u;y)))  =  Au  cos (uy).  (2.9) 

This  input  function  allows  us  to  assume  linearity  for  the  HVS. 

2.2.2  Evidence  of  Nonlinearity.  It’s  believed  that  near  the  photoreceptors 
in  the  HVS,  that  is,  near  the  rods  and  the  cones  of  the  retina,  the  response  of  the 
system  to  intensity  variations  is  nonlinear;  specifically,  it’s  logarithmic  [14:34].  The 
literature  has  many  examples  of  this  nonlinearity.  Consider  that  multiple  rods  on  the 
retina  must  be  stimulated  before  the  stimulus  is  perceived  even  though  one  quantum 
of  light  is  sufficient  to  stimulate  a  single  rod  [3:25].  Some  of  the  data  on  the  nonlinear 
portion  comes  from  research  into  the  Limulus,  or  horseshoe  crab,  begun  in  1932  by 
Hartline  and  Graham.  In  1970,  S.S.  Stevens,  after  replotting  the  data  of  Hartline 
and  Graham,  concluded  that  output  intensity  follows  a  power  law  function  of  input 
intensity  with  an  exponent  of  0.29  [8].  Other  nonlinear  effects  of  the  HVS  show  that 
there  is  more  to  perceived  brightness  than  simple  intensity.  Brightness  constancy 
refers  to  the  fact  that  an  object’s  brightness  tends  to  remain  constant  even  though 
its  illumination  may  change  [3:281].  Simultaneous  contrast  is  demonstrated  by  an 
object  which  appears  darker  in  front  of  a  light  background  than  it  did  in  front  of 
a  dark  background  even  though  the  light  reflected  from  its  surface  has  not  changed 
[3:277]. 
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2.2.3  First  Approximation:  Linear  Model.  If  the  HVS  response  to  input 
intensit  is  logarithmic,  the  response  can  be  “linearized”  if  the  transfer  function  is 
developed  with  an  input  of  an  exponential  sine  wave  [14:36].  With  nonlinearities 
accounted  for  by  developing  a  transfer  function  based  on  an  exponential  input  func¬ 
tion,  a  first  approximation  model  of  the  HVS  is  to  consider  it  a  linear,  time- invariant, 
and  space-invariant  (shift-invariant)  system  [8].  Since  the  system  is  assumed  to  be 
linear,  when  the  logarithm  of  an  intensity  pattern  is  increased,  the  system’s  response 
should  increase  proportionally.  Optical  spatial  invariance  is  a  good  assumption  near 
the  optic  axis  of  the  viewer  because  the  area  of  acute  focus,  the  fovea,  is  quite  small. 
Since  this  research  is  concerned  only  with  single-frame  images,  time-invariance  is  not 
an  issue  [8]. 

A  linear,  shift-invariant  model  is  proposed  for  the  HVS  as  follows:  an  image 
is  input  to  a  linear  system  (the  HVS),  modified  by  the  system’s  impulse  response 
function,  and  displayed  at  the  output  (the  brain).  The  modulation  transfer  function 
of  this  linear  system  is 


MTF  —  (0.2  +  0.45/)  exp(-0.18/)  (2.10) 

where  /  is  spatial  frequency  in  cycles /(degree  of  visual  angle  subtended)  [12].  This 
transfer  function  was  based  upon  the  work  of  Mannos  and  Sakrison  [11]  and  the 
work  of  DePalma  and  Lowry  [5]  [12],  A  plot  of  this  MTF  is  shown  in  Figure  2.1. 
From  the  plot  it  can  be  seen  that  this  model  of  the  HVS  has  bandpass  character. 

Since  this  model  is  linear  and  shift-invariant,  Fourier  techniques  may  be  applied 
to  its  analysis.  This  is  fortunate  as  other  researchers  have  applied  Fourier  analysis 
to  the  HVS.  A  model  assuming  that  the  human  brain  computes  the  two-dimensional 
Fourier  transform  of  input  data  has  been  applied  to  pattern  recognition  problems  [9] 
[lj.  In  addition,  the  Fourier  transform  domain  provides  greater  efficiency  than  do 
the  Walsh/Hadamard  or  Haar  transform  domains  for  number  of  features  required 
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Relative  Amplitude 


Figure  2.1  Modulation  Transfer  Function  of  a  Model  of  the  Human  Visual  System 


2-6 


for  minimum  mean-square  error  [8]  [1].  This  research  will  enhance  images  in  the 
frequency  domain  by  taking  the  Fourier  transform  of  the  reconstructed  image,  mul¬ 
tiplying  it  by  the  MTF  of  the  HVS,  and  taking  the  inverse  transform  to  yield  an 
output  image. 

2.2.4  Complete  Model.  A  complete  model,  however,  must  include  the  ob¬ 
served  nonlinearities.  A  simple  model  of  the  HVS  is  a  logarithmic  intensity  transform 
followed  by  a  MTF  [8]  [14:36].  Such  a  model  is  shown  in  Figure  2.2  [8]. 


Figure  2.2  Model  of  the  Human  Visual  System 


2.3  Quality  Assessment 

This  chapter  closes  with  a  brief  mention  of  image  quality  assessment.  The 
purpose  of  image  quality  assessment  is  to  measure  the  degree  of  distortion  one  can 
see  in  the  displayed  image  [7].  The  final,  and  best,  judge  of  image  quality  is  the 
human  image  interpreter.  Judging  the  merits  of  an  enhancement  routine  should 
involve  ranking  the  enhanced  images  in  order  of  quality.  Any  meaningful  quantitative 
fidelity  criterion  must  rank  enhanced  images  in  the  same  order  as  the  end  user  of 
the  images. 
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It  has  been  determined  that  the  mean  square  error  (MSE)  between  the  en¬ 
hanced  image  and  the  reconstructed  image  on  a  point-by-point  basis  doesn’t  corre¬ 
late  well  with  human  quality  assessments  [12]  [7].  This  is  probably  because  the  HVS 
doesn’t  process  the  image  in  a  point-by-point  fashion.  Rather,  it  extracts  spatial, 
temporal,  and  chromatic  features  for  neural  coding  [7].  A  good  quantitative  fidelity 
criterion  must  properly  weight  edge  fidelity  and  contrast  [7]. 


III.  Problem  Approach 


This  chapter  details  the  enhancement  techniques  which  were  applied  to  the 
reconstructed  images.  Two  of  these  techniques,  the  Sobel  function  and  unsharp 
masking,  enhance  edges  in  the  spatial  domain.  Another,  histogram  equalization,  is 
used  to  enhance  contrast  in  the  spatial  domain.  A  final  technique,  filtering  based 
on  the  human  visual  system  (HVS),  is  a  frequency  domain  technique.  This  chapter 
then  concludes  with  a  discussion  of  the  various  metrics  which  were  used  to  evaluate 
the  enhancement  techniques.  Before  explaining  the  enhancement  techniques,  it’s 
important  to  understand  the  basics  of  a  digital  image. 

3.1  Digital  Images 

Recall  that  an  image  is  a  two-dimensional  light  intensity  function  where 

i  and  j  are  spatial  coordinates.  The  brightness  of  an  image  at  a  point,  f(i,j),  is  the 
gray  level  at  that  point  [6:6].  A  digital  image  has  discretized  spatial  coordinates  and 
brightness  values  [6:6].  Now,  the  enhancement  techniques  used  here  will  be  explained 
in  detail. 

3.2  Sobel  Function 

It  was  pointed  out  in  Chapter  2  that  edges  are  the  predominant  spatial  quality 
of  interest  to  the  human  visual  system  (HVS).  Therefore,  it’s  desirable  to  enhance 
edges.  The  Sobel  function  is  one  spatial  domain  enhancement  technique  which  en¬ 
hances  edges.  A  spatial  domain  operation  which  averages  pixels  over  a  region,  such 
as  the  convolution  of  an  object  with  the  point  spread  function  of  the  system  which 
gives  rise  to  an  image,  will  blur  the  details  of  an  image.  Since  averaging  is  accom¬ 
plished  by  integration,  differentiation  should  have  the  opposite  effect  of  averaging 
and  should  sharpen  details.  Derivative  filters  accomplish  differentiation.  Gradients 
are  derivative  filters  [6:197]  and,  as  such,  may  be  used  to  enhance  edges. 
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Consider  a  3  x  3  image  region,  or  window,  as  shown  in  Figure  3.1.  The  intensity 
difference  between  the  third  and  the  first  column  approximates  the  derivative  in 
the  x-direction  whereas  the  intensity  difference  between  the  third  and  the  first  row 
approximates  the  derivative  in  the  y-direction.  This  window  is  passed  over  the  entire 
array.  Operations  on  the  border  of  the  array  are  accomplished  by  setting  the  value 
of  all  elements  on  the  border  to  0.  In  IDL,  the  center  of  the  3x3  window,  F(i,j ), 
is  transformed  into  G(i,j)  by 


G(»,  j)  =  \x\  +  |y|  (3.1) 

where 

x  =  (A2  +  2A3  +  A4)  —  (Ao  4*  2Ar  +  Ag)  (3-2) 

and 

y  —  (Ao  +  2Ai  +  A2)  —  (A6  +  2As  +  A4).  (3-3) 

Note  that  IDL  actually  implements  a  fast  approximation  of  a  true  Sobel  function 
which  saves  processing  time  [15:1-221].  The  true  Sobel  function  is  given  by  G(i,j )  = 
\Jx2  +  y1-  Figure  3.1  shows  an  array  both  before,  and  after,  a  Sobel  operation.  The 
numbers  indicate  the  gray  level  of  a  particular  element.  Notice  that,  before  the  Sobel 
operation,  an  edge  is  visible  in  which  the  gray  levels  are  separated  by  10.  After  the 
Sobel  operation,  the  location  of  the  edge  has  been  emphasized.  However,  the  gray 
levels  are  now  separated  by  40.  Thus,  the  edge  has  been  enhanced.  Note  that  all 
elements  on  the  edge  of  the  array  have  been  set  to  0. 

3.3  Unsharp  Masking 

The  purpose  of  unsharp  masking  is  to  highlight  fine  detail  in  an  image  or  to 
enhance  detail  that  has  been  blurred.  All  of  the  test  images  used  for  this  research 
have  been  blurred.  In  addition,  analysts  may  be  interested  in  the  fine  details  of  an 
image.  Recall  that  details  are  defined  by  their  edges.  Unsharp  masking,  like  the 
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Figure  3.1  Effect  of  Sobel  Operator 
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Sobel  function,  enhances  edges.  However,  it  differs  from  the  Sobel  function  in  that  it 
preserves  image  contrast.  Therefore,  it  would  seem  like  a  good  candidate  to  enhance 
images  in  need  of  edge  sharpening. 

High-boost  filtering  is  the  frequency  domain  equivalent  of  unsharp  masking 
[6:197].  An  understanding  of  high-boost  filtering  will  give  insight  into  unsharp  mask¬ 
ing.  If  a  lowpass  filtered  version  of  an  image  is  subtracted  from  the  image  original, 
the  result  is  a  highpass  filtered  image.  If  the  original  image  is  multiplied  by  an 
amplification  factor  A,  the  result  is  a  high-boost  filtered  image  [6:196]: 

High  boost  =  (A)  x  ( Original )  —  Lowpass.  (3.4) 

The  high-boost  image  retains  most  of  the  contrast  of  the  original  image;  however,  its 
edges  have  been  enhanced  by  removing  some  of  the  low  spatial  frequency  content. 

Unsharp  masking  is  the  spatial  domain  equivalent  of  high-boost  filtering.  The 
spatial  domain  equivalent  of  lowpass  filtering  is  image  averaging.  This  has  the  effect 
of  blurring  the  image.  The  image  is  first  blurred  by  a  boxcar  window  whose  width  is 
operator  specified.  The  boxcar  width  in  pixels,  w,  must  be  an  odd  number  smaller 
than  the  smallest  dimension  of  the  array  to  be  blurred.  Each  row  of  w  pixels  is 
summed  and  then  divided  by  w  to  yield  an  average.  Then,  the  row  results  are 
summed  and  divided  by  w  to  yield  the  new  value  for  the  pixel  in  the  middle  of  the 
array.  As  an  example,  consider  the  array  shown  in  Figure  3.2.  An  edge  is  clearly 
visible  with  opposing  elements  separated  by  11.  The  blurring  algorithm  leaves  all 
the  elements  on  the  border  unchanged.  Here,  w  =  3.  After  blurring,  the  opposing 
elements  of  the  edge  are  only  separated  by  about  6.  But,  after  subtraction  from  a 
scaled  version  of  the  original,  the  opposing  elements  of  the  edge  are  separated  by  16, 
an  increase  of  5  gray  levels.  Also,  note  the  most  of  the  contrast  of  the  original  image 
has  been  retained. 
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Figure  3.2  Effect  of  Unsharp  Masking 
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3.4  Histogram  Equalization 

The  goal  of  histogram  equalization  is  to  increase  image  contrast  by  increasing 
the  dynamic  range  of  gray  levels.  Many  of  the  test  images  used  for  this  research 
had  poor  contrast.  Therefore,  histogram  equalization  would  be  a  good  candidate  to 
enhance  images  in  need  of  contrast  enhancement. 

Let  the  variable  r k  represent  the  kth  gray  level  of  the  image  to  be  enhanced. 
The  gray  levels  are  in  the  interval  [0,  L  —  1]  with  L  being  the  number  of  possible 
gray  levels  Thus,  L  is  256  for  8-bit  color.  We  find  a  transform 

s*  =  T(rk)  (3.5) 

which  gives  a  new  gray  level  sk  for  each  gray  level  rk  of  the  original  image.  The 
transformation  function,  T(rk),  must  satisfy  the  following  conditions: 

(a)  T(rjt)  must  be  single- valued  and  must  monotonically  increase  on  the  interval 
0  <  rk  <  L  —  1  and 

(b)  0  <  T(rk)  <  L  -  1  for  0  <  rk  <  L  -  1. 

The  first  condition  preserves  the  order  from  black  to  white  in  the  gray  scale. 
The  second  condition  insures  that  the  new  gray  scale  mapping  is  consistent  with  the 
allowed  values  of  the  gray  scale  [6:173-180]. 

A  transformation  function  meeting  the  above  conditions  is  the  discrete  cumu¬ 
lative  distribution  function,  given  by 


k 


T{rk)  =  Yjniln 

3=0 

(3.6) 

k 

(3.7) 

3=0 


for  0  <  rk  <  1  and  k  =  0, 1, . . . ,  L  —  1.  In  the  above  equations,  rij  is  the  number  of 
times  the  kth  gray  level  appears  in  an  image,  n  is  the  total  number  of  elements  in 
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an  image,  and  pr (r,)  is  the  probability  of  the  kth  gray  level.  This  transformation 
produces  an  image  whose  gray  levels  have  a  uniform  density.  This  uniform  density 
means  an  increase  in  the  dynamic  range  of  the  pixels  which  increases  image  contrast 

[6:173-180]. 

IDL  accomplishes  histogram  equalization  by  first  employing  the  histogram 
function  to  obtain  the  density  distribution  of  the  input  array.  The  histogram  is  inte¬ 
grated  yielding  the  cumulative  density-probability  function.  The  color  table  lookup 
function  then  transforms  the  input  array  to  the  output  image  [16].  Examples  of 
histograms  before  and  after  equalization  are  shown  in  Figures  3.3  and  3.4. 

3.5  Human  Visual  System  Filter 

The  enhancement  techniques  discussed  thus  far  have  been  accomplished  in  the 
spatial  domain.  Enhancement  can  also  be  accomplished  in  the  frequency  domain. 
This  is  a  straightforward  process  of  computing  the  Fourier  transform  of  the  image 
to  be  enhanced,  multiplying  it  by  a  filter  transfer  function,  and  taking  the  inverse 
transform  to  yield  the  enhanced  image. 

As  discussed  in  chapter  2,  the  HVS  is  sensitive  to  certain  spatial  frequencies. 
The  modulation  transfer  function  (MTF)  of  the  HVS  has  a  bandpass  character.  If 
the  spectrum  of  an  image  is  filtered  by  this  MTF,  the  output  spectrum  will  contain 
mostly  those  frequency  components  of  interest  to  the  HVS.  Thus,  the  image  will  be 
enhanced. 

In  the  Nill  model  of  the  HVS  MTF,  spatial  frequency  is  expressed  in  units 
of  cycles/degree  [12].  As  IDL  expresses  spatial  frequency  in  units  of  pixels,  it  was 
necessary  to  modify  the  Nill  model  so  that  the  peak  transfer  would  be  1.0  and  so 
the  operator  could  control  filter  center  frequency,  bandwidth,  and  order.  Therefore, 
the  modified  Nill  model  will  be 

MTF  =  (0.52  +  0.45(// /c))eip(-(z2<order>)),  (3.8) 
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where  /,  the  spatial  frequency,  is  given  by: 


/  =  \Ji2+j 2, 


and  2,  a  variable  controlling  filter  roll-off,  is  given  by: 


z  = 


/2  ~  fc 


f  x  bw 


(3.9) 


(3.10) 


Also  included  in  the  expression  are  /c,  the  desired  filter  center  frequency;  order. 
the  filter  order;  i,  a  row  counter;  j,  a  column  counter;  and  bw ,  the  desired  filter 
bandwidth.  This  model  allows  the  operator  to  manipulate  filter  center  frequency 
from  0  to  96,  filter  order  from  1  to  10,  and  filter  bandwidth  from  0  to  48.  The 
parameter  limits  for  center  frequency  and  bandwidth  were  chosen  to  keep  the  filter 
realization  within  the  spatial  frequency  limit  in  IDL  of  181.  Filter  order  was  limited 
to  10,  because  at  10  it  already  has  ideal  character. 

Let  IT  be  the  Fourier  transform  of  the  reconstructed  image,  Je  be  the  Fourier 
transform  of  the  enhanced  image.  Then,  Ie  is  given  by: 


Ie  =  Ir  x  MTF. 

The  output  image,  ie,  is  simply  the  inverse  Fourier  transform  of  Ie. 


(3.11) 


3.6  Image  Quality  Assessment 

The  quality  of  images  is  assessed  through  fidelity  criteria.  A  subjective  fidelity 
criterion  is  the  measurement  of  image  quality  through  the  subjective  evaluations  of  a 
human  observer  [6:319-320].  An  objective  fidelity  criterion  measures  the  information 
lost  (sometimes  called  “error”)  between  the  input  and  output  images  [6:319-320]. 
The  enhancement  techniques  investigated  here  were  evaluated  by  both  subjective  and 
objective  fidelity  criteria.  The  fidelity  criteria  applied  to  the  enhanced  images  include 


an  observer’s  subjective  criterion  as  well  as  the  objective  criteria  of  bandwidth, 
entropy,  and  variance.  All  images  subjected  to  the  objective  criteria  are  first  cutout 
from  their  background.  This  is  accomplished  by  first  determining  the  location  of 
all  elements  in  the  array  of  the  true  image  that  are  part  of  the  satellite.  These 
elements  are  then  set  to  1  and  the  others  to  0.  This  new  array  is  then  multiplied 
by  the  enhanced  array  with  the  result  being  an  enhanced  satellite  on  a  0  gray  level 
background.  In  this  manner,  only  the  enhancement  of  the  satellite  is  considered 
rather  than  its  background.  The  remainder  of  this  section  describes  these  criteria. 


3.6.1  Observer’s  Subjective  Fidelity  Criterion.  This  is  simply  an  observer’s 
ranking  of  the  best  enhancement  technique  for  a  given  data  set.  There  was  only  one 
observer  used:  the  author.  The  observer  was  given  a  true  image  to  compare  to  the 
data  set.  “Best,”  as  used  here,  applies  to  the  image  showing  the  features  of  the  true 
image  most  clearly.  Each  data  set  included  the  true  image,  the  reconstructed  image, 
and  an  image  enhanced  by  each  of  the  enhancement  techniques  HVS  MTF  filtering, 
histogram  equalization,  sobel  function,  and  unsharp  masking. 


3.6.2  Bandwidth  Metric.  The  motivation  behind  this  metric  is  to  measure 
the  energy  in  the  image  spectrum  within  the  bandpass  of  the  HVS  MTF  [13].  In 
order  to  make  a  meaningful  comparison  between  the  reconstructed  image  and  the 
enhanced  image,  the  energy  of  the  two  images  must  be  normalized.  Also,  because 
the  volume  of  data  points  in  a  2-D  spectrum  is  huge,  and  because  it  is  difficult  to 
compare  a  3-D  surface,  the  image  spectra  are  radially  averaged  [13].  The  radially 
averaged  spectrum  is  [10]: 


Fradavg(,P)  — 


ZeFM 


number  of  pixels  at  distance  p ’ 


(3.12) 


where  F(p,0)  is  the  modulus  of  the  discrete  two-dimensional  Fourier  transform  of 
fnorm(x,y),  in  polar  coordinates  with  p  =  y/u2  +  v2,  where  u  and  v  are  the  spatial 
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domain  transforms  of  x  and  y.  In  simple  terms,  the  FFT  modulus  is  shifted  so  that 
its  zero  frequency  origin  is  in  the  center  pixel  quad  of  the  array. 

The  bandwidth  metric  becomes: 

Pupper 

BW=  £  \Fradavg(p)\,  (3.13) 

P—Plower 

where  the  piouier  and  pupveT  are  determined  empirically  to  fall  into  the  bandpass  of 
the  HVS. 

3.6.3  Entropy  Metric.  In  information  theory,  entropy  is  defined  as  the 
average  information  per  source  output  [6:326].  Entropy  yields  the  average  amount 
of  information  of  the  source  [6:326].  It  is  synonymous  with  uncertainty  and  as 
the  magnitude  of  entropy  increases,  more  information  is  associated  with  the  source 
[6:326].  For  this  research,  the  source  is  the  image.  Thus,  as  the  magnitude  of  entropy 
in  the  image  increases,  there  is  more  uncertainty  and,  hence,  more  information  in 
the  image.  Therefore,  a  good  image  should  have  high  entropy. 

Entropy  is  defined  by  the  equation: 

J 

entropy  =  -  £  P(vj)  log  P{vj )  (3.14) 

3= 1 

where  i >j  is  the  gray  level  of  a  particular  element  [6:326].  P{vj)  is  the  probability 
density  function,  or  histogram,  of  the  gray  levels  in  an  image.  This  number  was  com¬ 
pared  with  the  entropy  of  the  reconstructed  image  to  see  whether  the  enhancement 
technique  increased  the  information  of  the  image. 

3.6.4  Variance  Metric.  This  metric  computes  the  variance  of  the  image. 
It  gives  an  idea  of  how  much  the  gray  levels  stray  from  their  mean.  This  can  be 
thought  of  as  the  uncertainty  in  the  image.  Just  as  for  entropy,  a  good  image  should 
have  high  entropy. 
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This  metric  is  computed  from  the  square  of  the  standard  deviation  of  the  image 
and,  as  such,  is  object  dependent.  The  algorithm  is: 

variance  =  ( normalized  image  standard  deviation)2 .  (3.15) 
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IV.  Results 


4-1  Organization 

The  enhancement  techniques  of  human  visual  system  (HVS)  filtering,  his¬ 
togram  equalization,  Sobel  function,  and  unsharp  masking,  are  applied  to  a  matrix 
of  reconstructed  images.  The  fixed  parameters  of  these  simulations  axe  shown  in  Ta¬ 
ble  4.1.  The  images  are  of  three  Soviet  satellites:  the  Electro-optic  Research  Satellite 
(EORSAT),  shown  in  Figure  4.1,  the  Ocean  Research  5  (0CNR5)  satellite,  shown 
in  Figure  1.1,  and  the  Radar  Ocean  Research  Satellite  (RORSAT),  shown  in  Fig¬ 
ure  4.2.  The  variable  parameters  of  these  simulations  are  the  atmospheric  coherence 
diameter  (r0)  and  the  total  number  of  photons  per  image  {K). 

The  remainder  of  this  chapter  shows  samples  of  enhanced  images,  discusses  the 
results  of  the  observer’s  subjective  fidelity  criterion  as  well  as  the  various  objective 
criteria,  and  closes  with  a  comparison  of  the  enhancement  techniques. 

4-2  Samples  of  Enhanced  Images 

The  primary  motivation  behind  this  research  is  to  make  the  reconstructed 
images  look  more  like  the  true  images.  This  section  shows  examples  of  enhanced 
images  for  each  of  the  enhancement  techniques.  Figure  4.3  shows  a  reconstructed 
image  for  a  simulation  of  r0  =  7 cm  and  K  —  106.  Figure  4.4  shows  this  same  image 
after  HVS  filtering.  Note  that  the  solar  panels  and  the  antenna  have  been  sharpened. 

Figure  4.5  shows  a  reconstructed  image  for  a  simulation  of  r0  =  7cm  and 
K  —  104.  Figure  4.6  shows  this  same  image  after  histogram  equalization.  Note  that 
image  contrast  has  been  enhanced. 

Figure  4.7  shows  a  reconstructed  image  for  a  simulation  of  ro  =  10cm  and 
K  —  106.  Figure  4.8  shows  this  same  image  after  the  Sobel  function.  Note  that  the 
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Figure  4.1  EORSAT  True  Image 
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Figure  4.2  RORSAT  True  Image 
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Figure  4.3  Reconstructed  Image  Prior  to  HVS  Filtering,  ro  =  7 cm,  K 


le6 
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Figure  4.4  Reconstructed  Image  After  HVS  Filtering 
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Figure  4.6  Reconstructed  Image  After  Histogram  Equalization 
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Table  4.1  Image  Capture  Simulation  and  Reconstruction  Parameters 


number  of  frames 

o 

o 

*— H 

max  no.  subaps  across  max  dim  of  mirror 

10 

mirror  diameter 

1.0  m 

obscuration  diameter 

0.0 

wavelength 

500  nm 

target  distance 

500  km 

ccd  camera  noise  variance  (photons/ pixel) 

50  | 

partial  compensation  imaging 

no 

correct  tilt 

yes 

use  adaptive  optics 

yes 

no.  of  steps  for  integration  on  subap. 

20.0 

actuator  separation  grid  size  in  pupil 

11  cm 

avg  no.  of  pho.events/subap/integ.  time 

100.0 

length  of  one  side  of  object  array 

12.0  m 

radius  of  otf  in  pixels 

126 

wiener  filter 

no 

width  of  mtf  in  pixels 

45 

satellite’s  edges  have  been  enhanced.  Also  note  that  some  of  the  contrast  has  been 
lost.  This  is  a  negative  effect  of  the  Sobel  function. 

Figure  4.9  shows  a  reconstructed  image  for  a  simulation  of  r0  =  20cm  and 
K  =  104.  Figure  4.9  shows  this  same  image  after  unsharp  masking.  The  original 
image  was  scaled  by  2  and  the  blurring  was  done  with  a  7  x  7  pixel  window.  Note 
that  the  satellite’s  edges  have  been  enhanced.  Also  note  that  most  of  the  contrast 
has  been  retained.  This  is  an  advantage  over  the  Sobel  function. 


4-3  Results  of  Observer’s  Subjective  Fidelity  Criterion 

These  techniques  are  evaluated  using  the  observer’s  subjective  fidelity  criterion. 
Each  enhancement  technique  is  compared  to  the  reconstructed  image.  The  observer 
is  forced  to  judge  the  merits  of  the  technique  based  on  the  criteria  in  Table  4.2.  The 
results  of  this  evaluation  are  shown  in  Tables  4.3,  4.4,  and  4.5.  The  unsharp  masking 
enhancement  technique  produced  no  image  for  the  OCNR5  reconstructed  satellite 


4-8 


•"u*-  iiy'u^^ippipipp 


muw.yw  Mii.pi  H|.Bp  j.^.1 ...u 


Figure  4.7  Reconstructed  Image  Prior  to  Sobel  Function,  r0  =  10cm,  A"  =  le6 
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Figure  4.8  Reconstructed  Image  After  Sobel  Function 


o 


Figure  4.9  Reconstructed  Image  Prior  to  Unsharp  Masking,  r0  =  20cm,  K 


=  le4 
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Figure  4.10  Reconstructed  Image  After  Unsharp  Masking 
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Table  4.2  Key  to  Subjective  Criteria 


r0  atmosphere  coherence  diameter,  meters 
K  average  number  of  photons  per  image 
+  Technique  definitely  sharpened  some  feature. 

0  Technique  neither  sharpened  nor  blurred  image. 
Technique  blurred  overall  image. 


with  simulation  parameters  of  r0  =  0.2  and  K  =  104.  It  so  happens  that  with  a 
smoothing  window  of  7  pixels,  the  smoothed  array  is  almost  equal  to  the  input  array 
and  their  difference  is  zero.  This  gave  a  maximum  intensity  of  zero  for  the  unsharp 
masking  technique.  When  the  smoothing  window  was  increased  to  49  pixels,  the 
maximum  intensity  for  the  unsharp  masked  image  was  2.0.  (Note:  The  asterisk  in  a 
table  indicates  that  the  image  was  unavailable  for  evaluation.) 

Table  4.3  EORSAT  Subjective  Criteria 


r0  = 

0.2 

r0  = 

0.1 

Enhancement  Technique 

K=  le6 

■«* 

<u 

t— ' < 

II 

u 

II 

V 

r-H 

II 

HVS  filtering 

+ 

+ 

+ 

+ 

histogram  equalization 

- 

- 

- 

- 

sobel  function 

+ 

- 

- 

- 

unsharp  masking 

+ 

- 

- 

- 

r0  =  0.07 


K  —  le6 


K  =  le4 


+ 


+ 


0 


Table  4.4  OCNR5  Subjective  Criteria 


r0  = 

■  0.2 

H)  = 

0.1 

rO  = 

0.07 

Enhancement  Technique 

K  =  le6 

K  =  le4 

ESBI 

K  =  le4 

HVS  filtering 

+ 

+ 

+ 

+ 

+ 

+ 

histogram  equalization 

+ 

- 

+ 

- 

+ 

+ 

sobel  function 

+ 

- 

+ 

- 

+ 

- 

unsharp  masking 

+ 

* 

+ 

- 

+ 

- 
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Table  4.5  RORSAT  Subjective  Criteria 


r0  = 

0.2 

r0  = 

0.1 

r0  = 

0.07 

Enhancement  Technique 

K  =  le6 

rt* 

II 

* 

K  =  le6 

Tt4 

II 

* 

II 

* 

0) 

II 

* 

HVS  filtering 

+ 

+ 

+ 

+ 

+ 

+ 

histogram  equalization 

- 

- 

- 

+ 

- 

+ 

sobel  function 

+ 

- 

+ 

+ 

+ 

- 

unsharp  masking 

+ 

- 

+ 

- 

+ 

- 

Table  4.6  Effects  of  HVS  Filtering 


K  =  le6 

K  =  le4 

EORSAT,  r0  =  0.2 

+ 

+ 

EORSAT,  r0  =  0.1 

+ 

+ 

EORSAT,  r0  =  0.07 

+ 

0 

OCNR5,  r0  =  0.2 

+ 

+ 

OCNR5,  r0  =  0.1 

+ 

+ 

OCNR5,  r0  =  0.07 

+ 

+ 

RORSAT,  r0  =  0.2 

+ 

+ 

RORSAT,  r0  =  0.1 

+ 

+ 

RORSAT,  r0  =  0.07 

+ 

+ 

As  Tables  4.3,  4.4,  and  4.5  show,  all  of  the  enhancement  techniques  provide 
enhancement  under  some  conditions.  HVS  filtering,  however,  provides  enhancement 
regardless  of  conditions  as  shown  in  Table  4.6. 

Describing  the  conditions  under  which  histogram  equalization  may  be  usefully 
employed  is  not  as  clear  as  for  HVS  filtering.  As  Table  4.7  shows,  histogram  equal¬ 
ization  is  more  often  successful  (four  of  nine  cases  as  opposed  to  three  of  nine  cases) 
in  enhancement  under  conditions  of  low  photon  count.  The  usefulness  of  histogram 
equalization  under  differing  values  of  r0  is  undetermined  by  this  data.  It  would 
be  interesting  to  determine  whether  histogram  equalization  provides  enhancement 
under  very  low  atmospheric  coherence  diameters,  r0. 

The  Sobel  function  and  unsharp  masking  are  useful  under  conditions  of  high 
photon  count  as  shown  in  Tables  4.8  and  4.9.  All  of  the  unsharp  masked  images 
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Table  4.7  Effects  of  Histogram  Equalization 


EORSAT,  r0  =  0.2 

- 

- 

EORSAT,  r0  =  0.1 

- 

- 

EORSAT,  r0  =  0.07 

- 

+ 

OCNR5,  r0  =  0.2 

+ 

- 

OCNR5,  r0  =  0.1 

+ 

- 

OCNR5,  r0  =  0.07 

+ 

+ 

RORSAT,  r0  =  0.2 

- 

- 

RORSAT,  r0  =  0.1 

- 

+ 

RORSAT,  r0  =  0.07 

- 

+ 

Table  4.8  Effects  of  the  Sobel  Function 


K  =  le6 

K  —  le4 

EORSAT,  r0  =  0.2 

+ 

- 

EORSAT,  r0  =  0.1 

- 

- 

EORSAT,  r0  =  0.07 

- 

+ 

OCNR5,  r0  =  0.2 

+ 

- 

OCNR5,  r0  =  0.1 

+ 

- 

OCNR5,  r0  =  0.07 

+ 

- 

RORSAT,  r0  =  0.2 

+ 

- 

RORSAT,  r0  =  0.1 

+ 

+ 

RORSAT,  r0  =  0.07 

+ 

- 

were  enhanced  by  subtracting  an  array  smoothed  with  a  7  x  7  pixel  window  from  an 
unsealed  input  array.  Different  smoothing  windows  weren’t  explored.  One  attempt 
was  made  to  scale  the  input  array  by  2  and  the  pleasing  result,  at  least  in  contrast, 
is  shown  in  Figure  4.9.  Also,  as  is  the  case  for  histogram  equalization,  the  usefulness 
of  the  Sobel  function  and  of  unsharp  masking  under  differing  values  of  r0  is  undeter¬ 
mined  by  this  data.  It  would  be  interesting  to  determine  whether  these  techniques 
provide  enhancement  under  very  low  atmospheric  coherence  diameters,  r0. 


O 
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Table  4.9  Effects  of  Unsharp  Masking 


USEl 

M2BSM 

EORSAT,  r0  =  0.2 

+ 

- 

EORSAT,  r0  =  0.1 

- 

- 

EORSAT,  r0  =  0.07 

+ 

- 

OCNR5,  r0  =  0.2 

1 

* 

OCNR5,  r0  =  0.1 

+ 

- 

OCNR5,  r0  =  0.07 

+ 

- 

RORSAT,  r0  =  0.2 

+ 

- 

RORSAT,  r0  =  0.1 

+ 

- 

RORSAT,  r0  =  0.07 

+ 

- 

Table  4.10  EORSAT  Bandwidth  Metric 


r0  = 

0.2 

r0  = 

0.1 

rQ  = 

0.07 

Enhancement  Technique 

QJ 

f-H 

II 

K  =  le4 

K  =  le6 

r-H 

II 

K  =  le6 

Tt4 

r-* 

II 

* 

Reconstructed  Image 

.367 

.366 

.368 

.358 

.369 

.345 

HVS  filtering 

.388 

.350 

.424 

.420 

.454 

.338 

Histogram  Equalization 

.280 

.296 

.279 

.282 

.279 

.269 

Sobel  Function 

.373 

.331 

.370 

.274 

.365 

.260 

Unshaxp  Masking 

.308 

.303 

.318 

.283 

.323 

.191 

4-4  Results  of  the  Objective  Criteria 

In  this  section,  the  results  of  applying  the  objective  criteria  of  bandwidth, 
entropy,  and  variance  to  the  enhancements  of  the  reconstructed  images  are  presented. 
This  criteria  was  described  in  Chapter  3.  Recall  that,  for  all  of  the  objective  criteria, 
the  higher  these  numbers  are,  the  better  the  metric  considers  the  enhancement  to 
be.  For  reasons  cited  in  the  previous  section,  the  unsharp  masking  enhancement 
technique  produced  no  image  for  the  OCNR5  reconstructed  satellite  with  simulation 
parameters  of  r0  =  0.2  and  K  =  104.  (Note:  The  asterisk  in  a  table  indicates  that 
the  image  was  unavailable  for  evaluation.) 
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Table  4.11  EORSAT  Entropy  Metric 


r0  = 

0.2 

ro  = 

0.1 

r0  = 

0.07 

Enhancement  Technique 

CO 

»“H 

II 

* 

K  =  le6 

K  =  le4 

CO 

V 

H 

II 

<0 

t-H 

II 

Reconstructed  Image 

.819 

.848 

.826 

.869 

.844 

.862 

HVS  Filtering 

.864 

.889 

.865 

.904 

.886 

.943 

Histogram  Equalization 

.869 

.484 

.870 

.498 

.860 

.480 

Sobel  Function 

.725 

.327 

.757 

.440 

.824 

.566 

Unsharp  Masking 

.683 

.023 

.701 

.026 

.747 

.139 

Table  4.12  EORSAT  Variance  Metric 


ro  = 

0.2 

r0  = 

_ 

r0  = 

0.07 

Enhancement  Technique 

w^mm i 

K  =  le6 

■ct* 

QJ 

f-H 

II 

K  =  le6 

rH 

II 

* 

Reconstructed  Image 

43 

44 

43 

45 

43 

49 

HVS  Filtering 

585 

811 

410 

395 

325 

154 

Histogram  Equalization 

28 

35 

28 

35 

28 

36 

Sobel  Function 

88 

79 

87 

53 

78 

42 

Unsharp  Masking 

722 

2058 

674 

1936 

625 

4829 

Table  4.13  0CNR5  Bandwidth  Metric 


r0  = 

0.2 

r0  = 

0.1 

ro  = 

0.07 

Enhancement  Technique 

K  —  le6 

K  —  le6 

K  —  le4 

K  =  le6 

Reconstructed  Image 

.358 

.357 

.359 

.342 

.358 

HVS  filtering 

.258 

.435 

.454 

.426 

.313 

Histogram  Equalization 

.295 

.362 

.293 

.343 

.287 

.304 

Sobel  Function 

.277 

.254 

.277 

.251 

.274 

.274 

Unsharp  Masking 

.279 

* 

.282 

.151 

.267 

.110 
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Table  4.14  0CNR5  Entropy  Metric 


To  = 

0.2 

r0  = 

0.1 

ro  = 

0.07 

Enhancement  Technique 

<£> 

rH 

II 

<0 

i-H 

II 

* 

K  =  le6 

K  =  le4 

K  =  le6 

9J 

II 

* 

Reconstructed  Image 

mem 

1.26 

WLM 

MEM 

'WBSU 

1.13 

HVS  Filtering 

■HI 

1.31 

B 

wsm 

WSm 

1.30 

Histogram  Equalization 

1.16 

0.51 

WSm 

0.51 

mm 

0.51 

Sobel  Function 

1.23 

0.40 

f 

0.49 

1.23 

0.64 

Unsharp  Masking 

0.95 

* 

0.94 

0.01 

0.97 

0.14 

Table  4.15  0CNR5  Variance  Metric 


ro  = 

mm 

r0  = 

0.1 

r0  = 

0.07 

Enhancement  Technique 

r*H 

II 

K  = 

le4 

tf  =  le6 

K  =  le4 

K  =  le4 

Reconstructed  Image 

26 

27 

26 

28 

] 

HQ 

HVS  Filtering 

453 

92 

69 

106 

KBI3 

Histogram  Equalization 

21 

32 

21 

32 

31 

Sobel  Function 

36 

46 

35 

38 

35 

33 

Unsharp  Masking 

136 

* 

131 

7149 

155 

3470 

Table  4.16  RORSAT  Bandwidth  Metric 


ro  = 

0.2 

r0  = 

0.1 

ro  = 

0.07 

Enhancement  Technique 

K  =  le6 

<D 

r-H 

II 

K  =  le6 

Tt< 

II 

K  =  le6 

K  =  le4 

Reconstructed  Image 

.426 

.425 

.426 

.420 

.424 

.395 

HVS  filtering 

.406 

.450 

.381 

.424 

.409 

.3307 

Histogram  Equalization 

.324 

.381 

.323 

.373 

.326 

.3312 

Sobel  Function 

.355 

.334 

.356 

.332 

.355 

.294 

Unsharp  Masking 

.289 

.247 

.288 

.211 

.291 

.161 

4-18 


Table  4.17  RORSAT  Entropy  Metric 


r0  = 

0.2 

r0  = 

0.1 

ro  = 

0.07 

Enhancement  Technique 

<o 

0) 

II 

CO 

r-H 

II 

* 

K  =  le4 

B.dEifB.B 

<U 

*— -t 

II 

Reconstructed  Image 

.615 

.614 

.616 

.610 

.614 

.586 

HVS  Filtering 

.639 

.632 

.638 

.626 

.639 

.627 

Histogram  Equalization 

.553 

.393 

.551 

.385 

.528 

.366 

Sobel  Function 

.620 

.369 

.619 

.373 

.619 

.406 

Unsharp  Masking 

.573 

.030 

.578 

.045 

.567 

.136 

Table  4.18  RORSAT  Variance  Metric 


ro  = 

0.2 

r0  = 

0.1 

r0  = 

0.07 

Enhancement  Technique 

K  =  le6 

II 

K  =  le6 

K  =  le4 

Reconstructed  Image 

68 

69 

68 

69 

27 

74 

HVS  Filtering 

1961 

238 

7219 

300 

269 

1770 

Histogram  Equalization 

49 

59 

49 

59 

21 

58 

Sobel  Function 

65 

66 

65 

69 

35 

66 

Unsharp  Masking 

1438 

845 

1595 

1719 

155 

3970 
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4-5  Enhancement  Techniques:  A  Comparison  Based  On  Fidelity  Criteria 

It  is  desirable  to  compare  each  fidelity  criterion’s  evaluation  of  each  enhance¬ 
ment  technique.  Therefore,  points  are  assigned  to  each  evaluation  as  follows.  Each 
criterion  is  forced  to  rank  the  enhancements  for  a  given  realization  of  a  given  satel¬ 
lite.  Since  there  are  four  enhancements  for  each  realization,  they  are  ranked  first 
through  fourth.  The  observer  ranked  the  enhancements  subjectively.  The  other  cri¬ 
teria  ranked  an  image  first  if  it  had  the  highest  numerical  evaluation  and  fourth  if 
it  had  the  lowest.  First  is  given  4  points,  second  is  given  3  points,  third  is  given  2 
points,  and  fourth  is  given  1  point.  The  points  are  then  totalled  for  each  enhancement 
technique.  The  comparison  is  shown  in  Figure  4.11. 

This  figure  shows  that,  regardless  of  fidelity  criteria,  HVS  filtering  consistently 
provided  the  best  enhancement.  The  subjective  criteria,  bandwidth  metric,  and 
entropy  metric  considered  histogram  equalization  and  the  Sobel  fun  '  von  to  be  on  a 
par.  The  bandwidth  metric  and  the  entropy  metric  ranked  unsharp  masking  as  the 
poorest  enhancement  technique.  This  is  surprising  as  the  Sobel  function  and  unsharp 
masking  are  similar  techniques.  The  variance  metric  ranked  unsharp  masking  as  the 
best  technique,  a  result  in  sharp  contrast  to  the  rankings  of  the  other  metrics. 

It  is  concluded  from  these  results  that  the  bandwidth  metric  and  the  entropy 
metric  rank  the  techniques  similarly  to  the  observer’s  subjective  fidelity  criterion. 
It’s  understandable  that  the  bandwidth  metric  would  give  similar  rankings  as  the 
subjective  criterion.  Recall  that  the  radial  spatial  frequencies  chosen  for  summation 
in  the  bandwidth  metric  are  chosen  to  coincide  with  the  bandpass  of  the  HVS. 
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ENHANCEMENT  COMPARISON 


Figure  4.11  Comparison  of  the  Various  Enhancement  Techniques  by  the  Various 
Fidelity  Criteria 


o 
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V.  Conclusion 


5. 1  Application  of  IDL  Enhancement  Routines 

This  research  investigated  four  enhancement  routines  implemented  in  the  IDL: 
human  visual  system  (HVS)  filtering,  histogram  equalization,  Sobel  function,  and 
unsharp  masking.  HVS  filtering  preserves  spatial  frequencies  in  the  passband  of  in¬ 
terest  to  the  HVS.  Histogram  equalization  can  be  considered  a  contrast  enhancement 
technique;  that  is,  it  enhances  the  difference  between  light  and  dark  portions  of  the 
image.  The  other  two  enhancement  routines,  Sobel  function  and  unsharp  masking, 
can  be  considered  as  edge  enhancers.  They  highlight  the  location  of  edges  in  an 
image.  Highpass  filtering  is  the  frequency  domain  equivalent  of  spatial  domain  edge 
enhancement. 

All  of  the  above  mentioned  techniques  provided  enhancement  under  certain 
conditions  created  during  this  research.  These  conditions  included  varying  the  at¬ 
mospheric  coherence  diameters,  (r0),  and  the  total  number  of  photons  per  image, 
( K ),  under  which  the  reconstructed  image  data  set  was  simulated. 

It  was  found  that  HVS  filtering  provided  enhancement  under  all  conditions  of 
simulation.  Histogram  equalization  was  found  to  be  a  good  enhancer  of  images  with 
low  photon  counts.  This  technique  forced  these  images,  which  were  generally  dark, 
to  have  more  bright  elements,  enhancing  their  contrast.  However,  it  didn’t  help 
images  with  a  high  photon  count,  instead  making  them  overly  bright  and  washing 
out  their  features. 

The  Sobel  function  and  unsharp  masking  provided  good  enhancement  of  im¬ 
ages  with  high  photon  counts.  They  did  not  work  well  on  images  with  low  photon 
counts  because  the  edges  on  such  images  were  too  poor  to  be  enhanced.  A  future  di¬ 
rection  would  be  to  enhance  the  contrast  of  low  photon  count  images  with  histogram 
equalization  prior  to  edge  enhancement. 
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From  knowing  the  photon  count  of  an  image,  it  is  possible  to  select  the  best 
enhancement  technique.  Table  5.1  lists  the  best  enhancement  technique  based  on 
photon  count. 


Condition 

Technique 

all 

low  photon  count 
high  photon  count 

HVS  filtering 
histogram  equalization 

Sobel  function/  unsharp  masking 

Table  5.1  Technique  Selection  Matrix 


5.2  Fidelity  Criteria 

This  research  applied  objective  criteria  to  the  enhanced  images  in  an  effort  to 
compare  them  with  the  reconstructed  images.  The  objective  criteria  applied  included 
the  bandwidth  metric,  the  entropy  metric,  and  the  variance  metric. 

If  it’s  desired  to  replace  the  observer’s  subjective  fidelity  criterion  with  an 
objective  criterion,  then  either  the  bandwidth  metric  or  the  entropy  metric  would  be 
the  metric  of  choice.  They  ranked  the  various  enhancement  techniques  in  the  same 
order  as  did  the  subjective  criterion. 

5.3  Avenues  for  Future  Research 

This  project  was,  by  no  means,  an  exhaustive  study  of  satellite  image  enhance¬ 
ment.  Time  constraints  limited  the  quantity  of  enhancement  techniques  which  could 
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be  explored.  This  research  mapped  out  a  small  section  of  previously  uncharted 
territory.  The  following  is  a  list  of  potential  follow-on  research  topics. 

5.3.1  Topic:  Better  Unsharp  Masking  Technique.  The  unsharp  masking 
technique  used  in  this  research  really  did  nothing  more  than  the  Sobel  function:  it 
enhanced  edges.  A  good  unsharp  masking  technique  preserves  image  contrast  while 
enhancing  edges.  It  does  this  by  subtracting  the  blurred  image  from  a  scaled  version 
of  the  original  image.  The  unsharp  masking  routine  used  in  this  research  lacked 
this  seeding  function.  A  properly  chosen  scale  factor  will  preserve  the  contrast  of 
the  original  image.  A  better  unsharp  masking  routine  was  developed  late  in  this 
research  and  is  shown  in  Appendix  C.  It  produced  the  image  shown  in  Figure  4.10. 
However,  time  didn’t  permit  the  generation  of  a  test  matrix  with  this  technique  nor 
its  evaluation  by  the  quality  assessments.  Also,  experiments  should  be  conducted 
into  finding  an  optimal  window  size  for  this  technique.  As  the  unsharp  masked 
images  for  this  research  were  generated  automatically,  ail  were  smoothed  using  a  7 
x  7  pixel  window.  This  size  was  chosen  after  experimenting  with  it  on  a  few  images. 
It  isn’t  optimal  as  evidenced  by  what  it  did  to  the  OCNR5  image  with  r0  =  0.2  and 
K  =  104. 

5.3.2  Topic:  Effects  of  Lower  Photon  Count.  Only  two  different  photon 
counts  were  used  in  the  simulations  leading  to  the  data  set  used  for  this  research: 
K  =  104  and  106.  A  trend  was  clearly  shown  that  for  high  photon  counts,  the  edge 
enhancement  techniques  worked  best.  It  would  be  interesting  to  lower  the  photon 
count  to  103,  I02,  and  10,  and  see  the  effect  on  the  histogram  equalization  technique. 

5.3.3  Topic:  Effects  of  Lower  Atmospheric  Coherence  Diameter.  Only 
three  different  atmospheric  coherence  diameters  were  used  in  the  simulations  lead¬ 
ing  to  the  data  set  used  for  this  research:  r0  =  20cm,  10cm,  and  7cm.  No  trend  was 
clearly  shown  concerning  r0.  It  would  be  interesting  to  lower  the  atmospheric  coher- 
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ence  diameter  to  5cm,  4cm,  and  3cm,  and  see  the  effect  on  the  various  enhancement 
techniques  described  in  this  research. 

5.3.4  Topic:  Combining  Enhancement  Techniques.  In  this  research,  the 
enhancement  techniques  were  used  individually.  It  would  be  interesting  to  see  the 
effects  of  combining  the  techniques.  For  example,  an  image  with  poor  contrast  could 
be  run  through  histogram  equalization.  Following  that,  one  of  the  edge  enhancement 
techniques  could  be  applied.  As  a  final  step,  it  could  be  filtered  by  the  MTF  of  the 
HVS.  One  of  the  problems  to  solve  here  is  what  to  do  if  the  edge  enhancement 
technique  gives  a  range  of  intensity  values  which  exceed  the  range  of  the  color  table. 
The  color  table  won’t  do  justice  to  this  expanded  range.  This  problem  could  manifest 
itself  as  a  gray,  rather  than  a  white,  background  when  displaying  an  image  negative. 

5.3.5  Topic:  Inverse  Filtering  with  MTF  of  the  HVS.  This  research  ac¬ 
complished  linear  filtering  with  the  MTF  of  the  HVS  by  multiplying  the  Fourier 
transform  of  the  reconstructed  image,  IT,  by  the  MTF  of  the  HVS  to  yield  the 
Fourier  transform  of  the  enhanced  image,  Ie.  Thus,  Ie  was  given  by: 

Ie=ITx  MTF.  (5.1) 


Another  way  to  use  the  MTF  is  as  an  inverse  filter.  If  a  transfer  function 
is  causing  blurring  of  the  image,  the  image  can  be  shaipened  by  deconvolving  the 
point-spread  function  from  the  measured  image  [18],  In  the  frequency  domain,  this 
would  mean  dividing  the  Fourier  transform  of  the  enhanced  image  by  the  MTF  as 
follows: 


/e  = 


Ir 

MTF' 


(5.2) 


Appendix  A.  Spatial  Domain  Enhancement 


;  Capt  James  Treleaven 
;  2  October  93 


This  is  an  IDL  procedure  to  automatically  enhance  reconstructed  images. 

It  accomplishes  histogram  equalization,  Sobel  function,  and  unsharp  masking. 
It  should  be  stored  in  a  file  titled:  enhance. pro 
To  compile,  type:  .run  enhance 
To  execute,  type:  enhance,  file 

file  should  be  a  file  containing  the  reconstructed  image. 


PRO  enhance,  file 

;  This  section  rotates  reconstructed  images  into  the  same  orientation 
;  as  their  true  images,  file  should  be  a  256  x  256  unformatted, 

;  reconstructed  image. 

OPENR,  unit,  file,  /f77_unformatted,  /get.lun 
a  =  FLTARR(256,256) 

READU,  unit,  a 
FREE.LUN,  unit 
a  =  ROTATE (a, 4) 

OPENW,  unit,  file  +  ’.rcn’,  /f77_unformatted,  /get.lun 
WRITEU,  unit,  a 
FREE.LUN,  unit 


Hmnmntnmnmmmi 


;  This  section  saves  the  reconstructed  image  after  histogram  equalization. 

b  =  BYTE (a) 
b  =  HIST.EqUAL(b) 
b  =  FLOAT (b) 

OPENW,  unit,  file  +  ' .hequal’,  /f 77_unf ormatted ,  /get_lun 
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WRITEU ,  unit,  b 
FREE.LUN,  unit 


;This  section  saves  the  reconstructed  image  after  Sobel  function. 

c  =  SOBEL (a) 
c  *  FLOAT (c) 

OPENW,  unit,  file  +  ’.sobel’,  /f77_unf ormatted,  /get.lun 
WRITEU,  unit,  c 
FREE.LUN,  unit 


;This  section  saves  the  reconstructed  image  after  unsharp  masking. 

d  =  FIX(a  -  SM0CTH(a,7)) 
d  *  FLOAT (d) 

OPENW,  unit,  file  +  ’.unsharp',  /f77_unformatted,  /get.lun 
WRITEU,  unit,  d 
FREE.LUN,  unit 


END 
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Appendix  B.  Human  Visual  System  Filter 

;  Capt  James  Treleaven 
;  4  November  93 

;  This  is  a  portion  of  an  IDL  routine  to  compute  a  bandpass  filter  based 
;  on  the  MTF  of  the  human  visual  system.  For  the  complete  code,  see 
;  Capt  Michael  Roggemann,  Dept,  of  Engineering  Physics,  School  of 
;  Engineering,  Air  Force  Institute  of  Technology,  Wright-Patterson  AFB, 

;  Ohio . 

;  image  is  the  filename  of  the  file  containing  the  image  to  be  filtered 
;  bandtype  specifies  the  type  of  filter.  In  this  case,  it's  bandpass. 

;  center  is  the  desired  center  frequency  of  the  filter. 

;  bandwidth  is  the  desired  bandwidth  of  the  filter. 

;  order  is  the  desired  order  of  the  filter. 

imagesize  =  SIZE(image) 
distfun  =  DIST(imagesize) 
distfun(O)  =  le-4 

IF (bandtype  EQ  2)  THEN  $  ;  bandpass  filter 

filter  =  (distfun  *  distfun  -  center“2)  /  (distfun  *  bandwidth) 
filter  =  (0. 52+0. 45* (distfun/ center) )*exp(- (filter  “  (2  *  order)  <  25)) 
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Appendix  C.  A  Better  Unsharp  Masking  Routine 


;  Capt  James  Treleaven 
;  4  November  93 

;  This  is  an  IDL  procedure  to  automatically  unsharp  mask  a 
;  reconstructed  image. 

;  It  should  be  stored  in  a  file  titled:  unsharp. pro 
;  To  compile,  type:  .run  unsharp 
;  To  execute,  type:  unsharp,  file 

;  file  should  be  a  file  containing  the  reconstructed  image. 

PRO  unsharp,  file 

OPENR,  unit,  file,  /f77_unformatted,  /get.lun 
b  =  FLTARR(256 ,256) 

READU,  unit,  b 
FREE.LUN,  unit 
b  =  ROTATE (b, 4) 

;  A  is  a  scaling  factor  and  may  be  changed  as  needed.  It  should 
;  be  slightly  greater  than  1.0 
A  =  1.001 

d  =  FIX(A*b  -  SMOOTH (b, 7)) 
d  =  FLOAT (d) 

OPENW,  unit,  file  +  '.unsharp',  /f77_unf ormatted,  /get.lun 
WRITEU ,  unit,  d 
FREE.LUN,  unit 

TVSCL,  d 

END 
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This  research  investigated  the  enhancement  of  satellite  im¬ 
ages.  The  goal  was  to  develop  and  test  a  suite  of  image  enhancement  software 
routines  to  improve  the  quality  of  reconstructed  images  for  the  human  visual  system. 
The  primary  focus  was  to  enhance  satellite  features.  Enhancement  was  accomplished  in 
both  the  spatial  domain  and  the  frequency  domain.  In  the  spatial  domain,  routines 
were  developed  to  enhance  image  contrast  and  edges.  In  the  frequency  domain,  a  rou¬ 
tine  was  developed  using  research  into  the  human  visual  system.  The  transfer 
function  of  the  human  visual  system  was  used  to  develop  a  filter  for  frequency  do¬ 
main  enhancement.  A  data  set  of  images  was  developed  using  software  to  simulate  the 
image  degradation  caused  by  atmospheric  turbulence  and  the  randomness  of  the  image 
measurement  process.  The  parameters  varied  in  the  simulation  were  atmospheric  coher¬ 
ence  diameter  and  total  photon  count.  The  routines  were  applied  to  this  data  set  and 
the  results  were  evaluated  by  various  image  fidelity  criteria.  All  enhancement  rou¬ 
tines  provided  enhancement  dependent  upon  the  parameters  of  the  data  set  simulation. 
Contrast  enhancement  worked  well  when  photon  count  was  low.  Edge  enhancement  worked 
well  when  photon  count  was  high.  The  frequency  domain  filter  worked  well  always. 
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